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This  memorandum  investigates  the  differentiability  of  the  optimal  search  plan  m* 
for  a  stationary  target.  The  principal  result  (Theorem  3)  is  that  under  suitable 
assumptions  we  may  write  (for  almost  all  x) 


m*(T,x)  p (t, x)dt, 


i.e.,  m*  is  absolutely  continuous  in  tne  first  variable.  This  is  used  in  reference  [a]  to 
guarantee  the  existence  of  optimal  search  plans  for  a  class  of  deterministically 
moving  targets.  These  search  plans  are  transformations  of  the  functions  p. 

Definitions  and  basic  assumptions  are  presented  in  the  first  section  followed  in 
the  second  section  by  the  investigation  of  differentiability.  The  last  section  provides 
illustrations. 
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Basic  Definitions  amt  Assumptions 


This  section  provides  the  basic  definitions  and  assumptions  used  throughout 

the  memorandum.  We  shall  use  A  to  denote  Lebesgue  measure  on  E^  and  to  be 

v 

the  indicator  function  of  a  set  SC.  E  .  For  any  real  function  0  of  a  real  variable, 
let  q(0,K  ,A)  be  the  difference  quotient 


q(0,K,A) 


0(k  +  A)  -  0(k) 
A 


whenever  k  +A  and  k  are  within  the  domain  of  0 .  The  right  derivative  D  0,when  it 
exists,  is  given  by 


D+0(k)  ~  lim  q(f',K,A). 
0  <  A-*0 

The  left  derivative, when  it  exists,  is  given  by 


D~0(k)  -  lim  q(6>,  k  ,  A). 
0  >  A-0 


The  limits  are  permitted  to  be  infn.ite .  When  D  +0(k)  -D~0(k),  0  has  a  derivative 
at  k  which  is  usually  denoted  9(n)  or  D0(k).  These  notations  are  also  used  for  the  one¬ 
sided  derivatives  at  end  points  of  intervals.  In  case  0  is  a  real  function  of  severa. 
variables,  then  Dj,  ,  and  denote  the  partial  derivatives  with  respect  to  the  j**1 
argument.  We  use  inv[0]  to  denote  the  inverse  of  0  when  it  exists. 

The  local  effectiveness  function  b:{0,«)  -*  [0, 1]  is  assumed  to  have  the  following 
properties: 

(1)  b  is  strictly  increasing  with  b(0)  -0  and  lim  b(z)  =1, 

(2)  b  exists  and  is  continuous  and  strictly  decreasing  on  (0,«).  The  right 
derivative  b(0)  satisfies  0<  b(0)  <  °°,  and 
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(3)  b  exists  and  is  continuous  for  all  zc  [0,^)  and  the  right  derivative  b(0) 
satisfies  -co  <  b(0)  •:  0. 

A  function  $':((),«»)  -*(0,-*)  is  defined  b\ 


*(u)  = 


inv[b](u)  for  0  <  u  £  b(0) 
0  for  u  >  b(0) . 


In  view  of  the  conditions  on  the  local  effectiveness  function  b,  'i  is  continuous  and 
strictly  decreasing  with  limu_*Q  'I'(u)  =<*  and  4<(b(0))  -0.  The  function  'J?  is  dif¬ 
ferentiable  at  every  point  except  b(0).  We  have 


Moreover, 


and 


1 


*(u)  - 


b(*(u)) 


for  0  <  u  <  b(0) 


for  u  >  b(0) . 


D>(b(0))  -  -  lim  c ’I'(u) 

b(0)  u  b(0)- 


D  'l'(b(0))  =  0  =  lim  ,  *<u). 

u  —  b(0)  + 


The  derivative  'I'  is  continuous  on  (0,b(0))  and 


lbTiu_»0  *(u)  =  °°- 


An  explicit  bound  on  ^  may  be  obtained  by  letting 


ft  ( u)  =  sup{  | ’I'(v) |  :u  <  v <  b(0)}  foi  0  <  u  <  b(0). 


The  function  [i  is  finite  since  »I<  has  a  continuous  extension  on  [u,b(0)J  for  0  <  u<  b(0). 
By  the  mean  value  theorem  of  differential  calculus, 

*(b(0))  -  *(v)  =  *(T)[b(0)-v]  for  v  <  t  <  b(0), 


and  since  'tfbfO))  =0, 


|*(v)|  -  'P ( t ) |  [b(0)  -v]  <  P  (u)  [b(0)-v]  for  u  <  v  <  b(0) . 


,N 


The  target  location  probability  density  function  f:E  -*■[(),  °°)  is  assumed  to  be 
essentially  bounded  by  F<  00 ,  i.e.  ,  A({x:f(.x)  >  r})  =0  and  for  y  <  T 
A({x:f(x)  >  y})  >  0.  We  denote  by  k  the  product  k-  —  b(0)  F  <  00 . 


For  0  <  k  <  k  we  define  S(k)  by 


S(k)  - 


and  define  0  :(0,  Kq\ -*(0, «)  by 


x:f(x)  > 


b(0) 


Note  that  0<  A(S (k))  <  «,  since  /  f(x)dx-l. 

eN 

It  is  not  difficult  to  show  that  under  the  assumptions  on  b  and  f,  0  is  continuous 
and  strictlv  decreasing  with  lim  0(k)  and  0(k  )  =0. 

K  V  v 

It  can  be  shown  (see,  for  example,  reference  fbj)  that  under  assumptions  (1)  and 
(2)  for  b,the  search  plan  m* : -*•  [0, <»)  which  maximizes  detection  probability 
is  given  by 
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m*(t,x)  = 


^"f(x)  >  f°r  ^  ^  and 

0  for  f(x)  =  0. 

The  function  A.  :[0,°°)  -*(0,  k^]  is  defined  by  A  =inv[0]°C  where  C:[0,°°)  -*  [0,°°)  is 
some  differentiable  (finite  derivative)  strictly  increasing  function  with  C(0)  -0.  It 
follows  immediately  that  A  is  continuous  and  strictly  decreasing;  A(0)  =Kq  and 
lim^^  A(t)  =  0.  For  each  fixed  xe  E  ,  m*(-  ,x)  is  continuous  since  it  is  the 
composition  of  continuous  functions. 


Differential)} lity  of  m* 

Differentiability  of  the  optimal  search  plan  m*  is  investigated  in  this  section. 

The  principal  result  given  as  Theorem  3  is  that  under  the  assumptions  of  the  first 

N 

section,  m*(-  ,x)  is  absolutely  continuous  for  almost  all  xe  E  . 

Lemma  1.  The  function  0:(0,Kq)-*  [0 ,  °°)  has  finite  and  non-zero  left  and  right 
derivatives  on  the  open  interval  (0,Kq).  The  left  derivative  D_0(k^)  is  finite  but 
may  be  zero.  Moreover  0  is  differentiable  at  k  c(0,Kq)  if  and  only  if 
A({x:f(x)  -K'/b(0)})  =0. 

Proof.  In  order  to  establish  the  existence  of  the  left  derivative,  assume 
A<  0  and  kc(0,Kq].  Then  in  view  of  the  definition  of  0 


Without  loss  of  generality,  assume  that  for  some  fixed  e  >  0,  we  have 


M 


K 

<  e  i  T 


I 


Since  F  is  the  essential  bound  of  f,  for  almost  all  xcS(k+A), 


b(0)  > 


k+A 

WT  ~ 


k  -e 

~r 


>  0, 


and 


Since 


1*0 


f(x) 


K  +Av 

Tw~) 


S(k+A)-S(k)  -  {x:-r— —  <  f(x)  <  — }  , 
b(0>  b(0) 


it  is  easily  shown  that 


b(0)  -  ~ 5  1*0)  (~)  for  xc  [S(k+A)-S(k)J. 

Thus  for  almost  ail  xcS(/c+A) 


K  1 A 

Too" 


■)l  £  M 


x-e  b(0) 
r  1  k 


Since  S(k+A^)  -S(k)C  S(k +Ag) -S(k)  for  A^  >  A^  and 


O  S(k  HA)  -  S(k)  -  0. 
A  <  0 


We  have 


lim  /  4"  )dx  =  0, 

0  >  A-*0  S(k+A)-S(k)  A  f(x) 


since  the  integrands  are  uniformly  bounded. 
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■■*■■**>&* 


For  a  e  (0,  k ]  and  for  ail  xcS(k) 


lira  ql'l*.  Trr.  rA-)  77V  =  D_^(?7~r)77V 
0  >  A-*0  f(x)  i(x)  f(x)  vf(x)  f(x) 


The  convergence  is  essentially  bounded  since  for  almost  all  xe  S(k) 


|q'  *f(x)  ’  f(x)  f(x)  1  r  M  K  j  ■ 


Thus  the  bounded  convergence  theorem  insures  that  for  0  <  k  <  k 


since  A(S(k))  <  If  k  <  kq,  then  /f(x))  /f(x)  <  0  on  the  set  {x:f(x)  >  x/b(0)} 

which  has  non-zero  measure  (otherwise  rQ  wou’d  not  be  the  essential  bound).  Thus 
for  0  <  k  <  kq,  D  0(k)  ^0. 

Similarly,  the  existence  of  the  right  derivative  of  0  or  (O.k^)  is  established  by 
assuming  A  >  0  and  writing 


q(°  ’ K  ,A)  4(k+a>  q(*’  f(x)  *  f(x) )  f(x) dx "  4(«)-s(k+a)  a  ^(f(X) )dx- 


For  almost  all  xcS(k)  -S(k+A)  we  have 


Making  use  of  the  fact  that  $(b(0))  =  0,  it  follows  that 


I4(k)-S(k+A)  A  #(f(x))dxl  -A  {x:b(0)  <  fW  <  b(0)}/?(r)  ^  k+A 


which  vanishes  as  A  approaches  0.  For  xc,  ,A. ,  the  indicator  function  of  the  set 
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SK  +_^,  it  is  easy  to  show  that  for  xeS(h  )  and  0  <  K  <  Kg 


0  <A-0  XS(*  +A)(X)  q(*  ’  f(x)  ’  f(x) }  f(x)  °  ^  f(x) }  f  (x) 


It  is  also  not  difficult  to  show  that  for  xcS(k)  and  0  <  k  <  Kq 


Since  A(S(x))  <  «»,  it  follows  that  for  0<  k  <  /: 


0 


D+0<K)  =  /S(K>  D+^—dx. 


Finally,  for  0  <  k  <  kq 

D-,(k)  -  D+,(k)  -/^[DX^-)  -  D+,(^)]^x 

=  /{xf(-r  «  }D~*(b(0))~plx  =  ^-D"*(b(0))A({x:f(x) 
b(0) 

since  D+S^(k  /f(x))  =D  ^(k /f(x))  for  all  x  such  that  z.'/f(x)  <  b(0). 


Lemma  2.  The  function  A:[0,°°)  -  (0,  /<q]  lias  finite  right  and  left  derivatives 


on  (O,00).  The  right  derivative  exists  at  zero  but  may  not  be  finite.  The  function 
X  has  a  derivative  at  t  c  (0,=°)  if  and  only  if 


A({x:f(x)  =  7^})  =  0. 
b(0) 


Proof.  By  definition 


X(T)  =  inv[0]  (C(T))  for  0  <  T  <  <*>. 


Therefore,  we  may  write 


D  X(T) 


_C(T) 

D+0(X(T)) 


for  0  <  T  <  00 , 


whenever  the  derivative  in  the  right-hand  side  of  the  equation  exists.  For  T  -  0, 
we  have 


D+X(0)  = 


C(l>) 

D  ~0(koV 


Noting  that  X(T)  <  kq  for  T  >  0,  the  conclusions  follow  from  Lemma  1. 

Theorem  1.  The  optimal  search  plan  m*:[0,  °°)  x  EN— (0,  °°)  has  the  property 
that  for  all  x  e  EN,  m*(-  ,x)  has  finite  right  and  left  derivatives  on  (0,°°).  Moreover, 
for  all  Xf  E^,  m*(-  ,x)  is  differentiable  for  any  te  (O,00)  for  which 


A({x:f(x)  -  t^})  =  0. 
b(0) 


Proof.  Assume  without  loss  of  generality  that  f(x)  >  0.  Since 


we  may  write 


D“m*(t, x)  -  D+X(t)j^ 

for  all  te  (0,  °°)  for  which  the  derivatives  on  the  right-hand  side  exist  and  are  finite. 
For  all  t  e  (0,  °°),  A(t)  t  0  and,  therefore,  D_'I'(X(t)/f(x))  and  D+^(A(t)/f(x))  exist 
and  are  finite.  The  theorem  then  follows  from  Lemma  2. 

Theorem  2.  If  A({x:f(x)  =  r})  >  0,  then  D*  m*(0,x)  exists  and  is  finite  for 
allxeE^.  If  A({x:f(x)  =  r})  =  0,  then  d|  m*(0,  x)  exists  and  is  finite  for  all  x 
for  which  f(x)  ^  T. 

Proof.  If  D~  4'(A(0)/f(x))  and  D+  A (0)  exist  and  are  finite,  then  D^m*(0,x) 
exists  and  is  finite.  In  this  case 


where 


and 


D| m*(0,x)  =  D+X(0) 


D 


i(x)> 


(  1 

b(0) 


0 


for  f(x)  =  F 


otherwise, 


D+A{0)  = 


C(0) 

D-0(ko)' 


Now 
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D-0<*0»  =  /{x:f(x)  =  D  »-*«»>  iS* 

=  ~  ”  A({x:f(x)  -  T}). 

b(o>r 

Therefore,  the  first  statement  of  the  theorem  is  established. 

The  second  statement  is  proved  by  observing  that  for  xeE^,  if  f(x)  /  T,  then 
there  exists  a  <  kq  such  that  f(\)  <  «j/b(0).  Also  there  exists  tj  >  0  such  that 
r  ^  <  Aft)  <  kq  for  0  <  titj.  This  means  that  for  0  <.  t  <  tj , 

Mi  >  MM. >  ;J(0), 

f(x)  K1 

and,  therefore, 


m*(t,x)  =0  for  0<.t£tj, 

Thus  D+m*(0,x)  -  0,  and  this  completes  the  proof. 

Theorem  3.  For  almost  all  x  e  EN,  the  functions  m*(-  ,x)  are  absolutely 
continuous  and  the  function  values  may  be  written 

m*(T,x)  =  /^D^(t,x)dt  for  0  <  T  < 

Proof.  For  all  xeEN,  m*(-  ,x)  is  continuous  and  non-decreasing  on  [0,T]. 
Thus  m*(-  ,x)  is  of  bounded  variation  on  [0,TJ.  By  Theorems  1  and  2,  Dj  m*(*  ,x) 
exists  and  is  finite  on  [0,T]  for  almost  all  x.  Then  by  Lebesgue's  version  of  the 
fundamental  theorem  of  integral  calculus  (page  596  of  reference  [c]) 

rp 

m*(T,x)  =  m+(t,x)  dt 

except  on  the  exceptional  set  of  x  having  measure  zero.  This  concludes  the  pi’oof. 


-11- 


Illustrations 


As  an  illustration  of  the  above  results,  let  b  be  the  exponential  effectiveness 
function  b(z)  =  1  -e-z  for  zefO,00),  Thus  b(z)  =  e-z  and  'l'(u)  =  -ln(u).  Note  that 
b(0)  =  1.  Assume  that  C(t)  =t. 

First  consider  a  two  cell  example.  For  pj  >  p2  and  disjoint  Rj,  R2C_E" 
such  that  A(Rj)  =  A(R2)  =1.  let 

Pj  for  xeRj, 

f(x)  =  <p2  for  xeR2,  and 

0  otherwise. 

It  follows  that  T  =  Kq  =  Pj  and 

j  RjURr,  for  0  <  k  <  p2 
S (k)  =  { x:f(x)  >  k}  =  \ 

[Rx  for  P2  <  x  <  Pi- 

Since 


0<k)  =  L 


(K) 


one  has 


Thus 


9(k) 


for  0  <  k  <.  p2 


for  p 2  <  ac  <  Pj. 


Pje"4  for  0  <  t  <  Infpj/pg) 


X(t)  = 


-t/2 


for  t  >,  lnfpj/pg). 


Finally  for  x  e  Rj , 


t  for  0  £  t  <  InO^/pg) 

m*(t,  x)  = 

j  t 

-+  ln{p1/'p2)  for  t  >  ln(pj/p2) 

and  for  xfR2, 

0  for  t  <  lnfpj/p.,) 

m  +  (t,  x)  =  < 

+  'n(P]/P2)  for  t  >  InfPj/pg). 

Note  that  in  accordance  with  Theorem  1 ,  m*(* ,  x)  has  a  finite  derivative  for 
all  t  e  (0,  «>)  for  which 

A({x:f(x)  =  A(t)})  =0. 


This  condition  fails  to  hold  only  when  t  =  lnfp^/pg),  in  which  case 

A({x:f(x)  =  X (t) } )  =  A{x:f(x)  =  p2}  “  1. 

In  addition,  A({x:f(x)  =  T  =  Pj})  =  1,  and,  therefore,  by  Theorem  2,  D+m*(0,x) 

o 

exists  and  is  finite  for  all  x  c  E  , 

The  next  illustration  considers  a  situation  where  D| m*(0,x)  is  not  finite  for 
all  x.  Lot  f  be  a  bivariate  normal  distribution,  i.e.  ,  for  x  =  (xj,x2)  and 
r(Xj,x2)  -  flxj/ffj]2  +  [x2/a2]2)J, 

f(x)  =  9  }  exp(-‘r(x,y)2). 

Z7T  (J  j  Ur) 
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Since  A({x:f(x)  \(t)})  =0  for  all  t  >  0,  m*(- ,  x)  must  be  differentiable  fo*  all 

xcEN  when  t  >  0  according  to  Theorem  2. 

It  is  well  kn^wn  that  if  Cft)  =  t,  then  for  t  >  0; 

|kVT  -  Jr(Xjfx2)2  for  r(Xj ,  x2)^  <.  2KVt 

m^t.Xj.Xg)  =  < 

(0  otherwise, 

o 

where  K  =  (~ o  j  ov>).  For  all  t  >  0  and  (x^.x^)  f  E  , 


Dj  m^t.Xj.Xg)  =  —  . 

In  accordance  with  Theorem  3,  D|m*(0,Xj,X2)  <  for  (Xj.Xg)  ^  (0,0).  Only  at 
the  point  (0,0)  (a  set  of  measure  zero)  does  m*  fail  to  be  finite. 


Henry  R.  Richardson 
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